Measure - Theoretic Boundaries of Markov Chains , 0 - 2 Laws And

نویسنده

  • Vadim A. Kaimanovich
چکیده

The classic Poisson formula giving an integral representation of bounded harmonic functions in the unit disk in terms of its boundary values has a long history (as it follows from its very name). Given a Markov operator P on a state space X one can easily deene harmonic functions as invariant functions of the operator P, but in order to speak about their boundary values one needs a boundary, because no boundary is normally attached to the state space of a Markov chain (as distinct from bounded Euclidean domains common for the classic potential theory). One way of getting rid of this nuisance is to try to nd a topological compactiication of the state space naturally connected with the Markov operator P. This problem was solved by Martin by constructing the famous Martin boundary which when applied to a Markov operator gives an integral representaion for all positive harmonic functions in terms of extreme harmonic functions (see 17] 46] for references). Nonetheless, the Martin approach has some drawbacks. In the rst place, one needs a topology on the state space to be able to speak about its compactiications, and the transition probabilities must be absolutely continuous to ensure that the cone of positive harmonic functions is a simplex 17]. The Martin boundary doesn't have good functorial properties (see 20], 40], 43] for a discussion of problems connected with the Martin boundary for a product of two chains, and 7] for an example when the Martin boundary for a polynomial P = P (n)P n is \much worse" than the Martin boundary for P in a very simple situation). Finally, from a probabilistic point of view it would be more natural to ask rst about suitable measure-theoretical objects, and only then about topological ones. A function f being bounded harmonic is equivalent to the sequence f(y n) being a bounded backward martingale with respect to the decreasing sequence of coordinate-algebras A 1 n = fy k : k ng determined by the behaviour of the chain at times k n. Thus, for any bounded harmonic function f there exists the limit b f(y) = lim f(y n). The function b f is measurable with respect to the stationary-algebra in the path space consisting of the sets which are invariant under the time shift, and, conversely, every such bounded b f determines a harmonic function. If the path space is a Lebesgue …

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Evaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes

Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded  DNA virus. There were two approaches for prediction of each Markov Model parameter,...

متن کامل

2 00 8 Limit Laws for k - Coverage of Paths by a Markov - Poisson - Boolean Model

Let P := {Xi}i≥1 be a stationary Poisson point process in Rd, {Ci}i≥1 be a sequence of i.i.d. random sets in Rd, and {Y t i ; t ≥ 0}i≥1 be i.i.d. {0, 1}-valued continuous time stationary Markov chains. We define the Markov-Poisson-Boolean model Ct := {Y t i (Xi + Ci), i ≥ 1}. Ct represents the coverage process at time t. We first obtain limit laws for k-coverage of an area at an arbitrary insta...

متن کامل

Limit Laws for k-Coverage of Paths by a Markov-Boolean Model

Let P := {Xi}i≥1 be a stationary point process in Rd, {Ci}i≥1 be a sequence of i.i.d random sets in Rd, and {Y t i ; t ≥ 0}i≥1 be i.i.d. {0, 1}-valued continuous time stationary Markov chains. We define the Markov-Boolean model Ct := {Y t i (Xi + Ci), i ≥ 1}. Ct represents the coverage process at time t. We first obtain limit laws for k-coverage of an area at an arbitrary instant. We then deriv...

متن کامل

Empirical Bayes Estimation in Nonstationary Markov chains

Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical  Bayes estimators  for the transition probability  matrix of a finite nonstationary  Markov chain. The data are assumed to be of  a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...

متن کامل

Limit Laws for k - Coverage of Paths by a Markov - Poisson - Boolean Model

Let P := {Xi}i≥1 be a stationary Poisson point process in Rd, {Ci}i≥1 be a sequence of i.i.d. random sets in Rd, and {Y t i ; t ≥ 0}i≥1 be i.i.d. {0, 1}-valued continuous time stationary Markov chains. We define the Markov-Poisson-Boolean model Ct := {Y t i (Xi + Ci), i ≥ 1}. Ct represents the coverage process at time t. We first obtain limit laws for k-coverage of an area at an arbitrary insta...

متن کامل

Bounds for the L 2 Spectrum of Reversible Markov Chains with Dirichlet Boundary

Let (X(t); t 2 IR) be a reversible Markov chain on a nite set , with invariant measure. For A , let TA := infft 0; X(t) 2 Ag. We consider the tail distribution of TA for a start with a probability measure 0 such that 0(A) = 0. We prove that P 0 (TA > t) jj0jj2;; A c exp(?At), t > 0, where Ac is restricted to A c , jj0jj 2 2;; A c := P x2A c (0(x) 2 ==Ac(x)), and A > 0 is the spectral gap associ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1991